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IMAGE DISPLAY SYSTEM 

This application is based on application No. Hll-252647 filed in Japan on 
September 7, 1999, the entire contents of which are hereby incorporated by reference. 

5 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to an image display system, and particularly to 
an image display system that displays an image in such a way as to surround an 
10 observer and thereby offers a high degree of realism. 

Description of the Prior Art 

In the field of virtual reality that is aiming at presenting an image of an 
actually nonexistent space with a high degree of realism, it is essential to display an 
15 image representing as wide a space as possible. To achieve this, it has been 
becoming increasingly common to display an image not only in front of an observer 
but also around the observer so that the image surrounds the observer. For 
example, according to one conventional proposal, a box-like observation room so 
large as to house an observer is constructed, and an image is displayed on the side 
20 faces, on the floor face, and even on the ceiling face thereof so that the observer is 
surrounded by the four-, five-, or six-faced image. 

In such an image display apparatus, the wall faces of the observation room 
are used as screens onto which enlarged images of images formed on image display 
devices are projected. Here, as many image display devices as the number of 
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screens are provided, and, to permit the images formed on the image display 
devices to be projected onto the screens, as many projection optical systems as the 
number of screens are provided. To prevent the light projected from the 
projection optical systems from being intercepted by the body of the observer, it is 
5 customary to use transmissive screens onto which an image is projected from 
outside the observation room. Moreover, to minimize the size of the entire 
apparatus, mirrors for turning the optical path of the projected light are arranged 
between the projection optical systems and the screens. 

Furthermore, to give perspective to the displayed image (i.e. to make the 
10 displayed image three-dimensional), a conventional method is used in combination 

31 whereby two images that differ in their view points so much as to correspond to the 

Uj 

« parallax between the right and left eyes are displayed alternately, with one image 

directed to the right eye and the other directed to the left eye. In this case, the 
observer observes the image while wearing goggles provided with shutters that are 
15 switched between a light transmitting state and a light intercepting state in 
synchronism with the alternation of the two images. Moreover, it is also common 
to accompany the displayed image with matching sound to offer a higher degree of 
realism to the observer. 

In this way, there have already been realized image display apparatuses that 
20 offer a very high degree of realism by surrounding an observer with an image so 
that as wide a space as possible is represented by the image, and by using sound as . 
well. 

However, such conventional image display apparatuses still leave room for 
improvement both in their construction and in the kinds of realism they can offer. 
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For example, as to the construction, such image display apparatuses require so 
many image display devices and projection optical systems as the number of 
screens and thus require a complex construction that makes their miniaturization 
difficult. Moreover, the observation room is installed on a non-mobile basis, 
5 which greatly limits the location where the projected image can be observed. As 
to the kinds of realism, such image display apparatuses offer solely sensation as is 
experienced on the earth and do not exploit senses other than sight and hearing. 
For example, no image display apparatus has ever been proposed that offers 
sensation as is experienced underwater or under low gravity. 
10 Furthermore, conventional image display apparatuses have also the 

disadvantage of not permitting the image displayed with a high degree of realism to 
It be shared by two or more observers. It is possible to house two or more observers 

K in one observation room, but the two observers cannot be in exactly identical 

8 

p positions at a time, and therefore, even if the displayed image is optimized for one 

O 15 observer, it is not so for the other, who is thus obliged to observe the image with a 
|J lower degree of realism. 

It is possible to construct a plurality of observation rooms to permit the 
observer in every observation room to observe an optimized image. This 
construction, however, is equivalent to constructing a plurality of image display 
20 apparatuses independently, and thus cannot provide each observer with the 
sensation that the other observers are around. 
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SUMMARY OF THE INVENTION 

An object of the present invention is to provide an image display system that 
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offers a high degree of realism, and more particularly to simplify the construction 
of such an image display system. 

To achieve the above object, according to one aspect of the present invention, 
an image display system is provided with: at least two screens onto which images 
5 are projected; at least one display device for displaying the images that are to be 
projected onto the screens, the total number of display devices being smaller than 
the total number of screens; and at least one projection optical system for projecting 
the images displayed on the display device onto the screens. 

In this image display system, the total number of display devices is smaller 
p 10 than the total number of screens, so that a single display device displays two or 
81 more images to be projected onto two or more screens. The total number of 

a? s 

display devices may be one. It is possible to make a single display device display 
two or more images, for example, by making it display different images in different 
periods, or by making it display different images in different parts of the display 
15 surface thereof. 

To permit the images displayed on the display devices to be projected onto 
the screens, it is necessary to provide at least as many projection optical systems as 
the number of display devices. Thus, the number of projection optical systems 
can also be made smaller than the number of screens. By reducing the number of 
20 display devices in this way and reducing the number of projection optical systems 
accordingly, it is possible to simplify both directly and indirectly the construction 
of the image display apparatus, and thereby make the image display apparatus 
compact. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

This and other objects and features of the present invention will become 
clear from the following description, taken in conjunction with the preferred 
embodiments with reference to the accompanying drawings in which: 
5 Fig. 1 is a diagram showing the outline of the overall construction of the 

image display apparatus of a first embodiment of the invention; 

Fig. 2 is a perspective view of the projector unit of the image display 
apparatus of the first embodiment; 

Fig. 3 is a diagram schematically showing an example of images projected 
10 onto the observation room of the image display apparatus of the first and a second 
embodiment of the invention; 

Fig. 4 is a diagram showing the images displayed on the display devices to 
project the images shown in Fig. 3 in the image display apparatus of the first 
embodiment; 

15 Fig. 5 is a diagram showing the outline of the overall construction of the 

image display apparatus of the second embodiment; 

Fig. 6 is a perspective view of the projector unit of the image display 
apparatus of the second embodiment; 

Fig. 7 is a diagram showing the images displayed on the display devices to 
20 project the images shown in Fig. 3 in the image display apparatus of the second 
embodiment; 

Figs. 8 A, 8B, and 8C are diagrams showing the outline of the overall 
construction of the image display apparatus of a third embodiment of the 
invention; 
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Fig. 9 is a diagram showing the outline of the overall construction of the 
image display apparatus of a fourth embodiment of the invention; 

Figs. 10 A, 10B, and 10C are diagrams showing the outline of the overall 
construction of the image display apparatus of a fifth embodiment of the invention; 

Fig. 11 is a diagram showing the outline of the overall construction of the 
image display apparatus of a sixth embodiment of the invention; 

Fig. 12 is a perspective view of a side face of the observation room of the 
image display apparatus of the sixth embodiment; 

Fig. 13 is a perspective view of the frame member of the observation room of 
the image display apparatus of the sixth embodiment; 

Fig. 14 is a horizontal sectional view of the frame member of the observation 
room of the image display apparatus of the sixth embodiment; 

Fig. 15 is a perspective view of a side face of a modified example of the 
observation room; 

Fig. 16 is a horizontal sectional view of the frame member of a modified 
example of the observation room; 

Fig. 17 is a perspective view showing the outline of the construction of the 
image display apparatus of a seventh embodiment of the invention; 

Fig. 18 is a perspective view of the floor face of the image display apparatus 
of the seventh embodiment; 

Fig. 19 is a perspective view of the treadmill of the image display apparatus 
of the seventh embodiment; 

Figs. 20A, 20B, and 20C are perspective views of the turntable of the image 
display apparatus of the seventh embodiment; 



Fig. 21 is a perspective view showing the outline of the construction of the 
image display apparatus of an eighth embodiment of the invention; 

Fig. 22 is a perspective view of the observation room, in its closed state, of 
the image display apparatus of the eighth embodiment; 

Fig. 23 is a perspective view showing the outline of the construction of the 
image display apparatus of a ninth embodiment of the invention; 

Fig. 24 is a block diagram showing the outline of the configuration of the 
controller of the image display apparatus of the ninth embodiment; and 

Fig. 25 is a diagram schematically showing the image and the observer in the 
observation room of the image display apparatus of the ninth embodiment. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, image display apparatuses embodying the present invention will 
be described with reference to the drawings. Fig. 1 shows the outline of the 
overall construction of an image display apparatus 1 of a first embodiment of the 
invention. The image display apparatus 1 is provided with an observation room 
10 and a projector unit 14, and is of a projection type in which an image displayed 
in the projector unit 14 is projected onto the observation room 10. An observer 
observes the projected image from within the observation room 10. 

The observation room 10 has the shape of a hollow rectangular 
parallelepiped, and has a front face 11a, a left side face lib, a right side face 11c, a 
floor face lid, a ceiling face lie, and a rear face llf. The observation room 10 is 
so large as to house the observer in an standing position. The rear face llf of the 
observation room 10 is openable so as to serve as a door that permits the observer 
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in and out. 

The other five faces 11a to lie than the rear face llf of the observation room 
10 are made of a material that transmits visible light, and have fine irregularities 
formed over the entire surfaces thereof to disperse the light that passes 
5 therethrough. These faces serve as screens onto which the image from the 
projector unit 14 is projected. Hereafter, the faces 11a to lie will be referred to 
also as screens. The observer inside the observation room 10 is surrounded by 
five screens located above, below, on the left of, on the right of, and in front of the 
observer, and thus the image presented to the observer covers a very wide space. 
10 At the outward-facing (back) sides of the four screens lib, 11c, lid, and lie 

of the observation room 10, total-reflection mirrors 12b, 12c, 12d, and 12e are 
j disposed that individually direct the light from the projector unit 14 to those 

t: screens. The total-reflection mirrors 12b to 12e are arranged at angles to the 

x ~r. screens lib to lie, with their rear face llf side ends located close to the screens 

ill 

a 15 lib to lie. 

0 The projector unit 14 is arranged just opposite the front face 11a of the 

ess! 
s 

observation room 10. Fig. 2 shows the construction of the projector unit 14. The 
projector unit 14 is composed of an image display device 15, two cross prisms 16a 
and 16b, four total-reflection mirrors 17b, 17c, 17d, and 17e, six lens units 18, 18a, 
20 18b, 18c, 18d, and 18e, and five shutters 19a, 19b, 19c, 19d, and 19e. 

The image display device 15 displays an image to be projected onto the 
screens 11a to lie. In this embodiment, as the image display device 15 is used a 
trans missive liquid crystal display device. The image display device 15 does not 
simultaneously display the entire image covering a wide space that is to be 
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presented to the observer, but displays it on a time-division basis. That is, the 
total area covered by the image to be presented to the observer is divided into five 
parts that correspond to the five screens, and the images of those five parts are 
displayed sequentially at predetermined time intervals. 
5 The five lens units 18a to 18e each constitute a projection optical system 

together with the lens unit 18. That is, the image display apparatus 1 is provided 
with five projection optical systems that share the lens unit 18 as their front unit 
and that use the lens units 18a to 18e respectively as their rear unit. The 
projection optical system constituted by the front unit 18 and the rear unit 18a 
i 10 projects the light from the image display device 15 toward the screen 11a so as to 
B1 focus it on the screen 11a. The four projection optical systems constituted by the 

front unit 18 and the rear units 18b to 18e respectively project the light from the 
image display device 15 toward the total-reflection mirrors 12b to 12e so as to focus 
it on the screens lib to lie. 
15 The cross prisms 16a and 16b are each composed of four rectangular prisms 

cemented together. On the cementing surfaces of the cross prisms 16a and 16b, 
semi-transmissive films are provided that partially transmit and partially reflect 
light and that thus act as half mirrors. The cross prism 16a is arranged in such a 
way that the line at which its four rectangular prisms intersect extend 
20 perpendicularly (vertically), and the cross prism 16b is arranged in such a way that 
the line at which its four rectangular prisms intersect extend levelly (horizontally). 
The light from the image display device 15 first passes through the front unit 18 of 
the projection optical systems, and is then split by the cross prism 16a into one 
light beam transmitted therethrough and two light beams reflected therefrom. The 
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light beam transmitted here is then further split by the cross prism 16b into one 
light beam transmitted therethrough and two light beams reflected therefrom. 

The total-reflection mirrors 17b and 17c respectively direct the light beams 
reflected from the cross prism 16a to the rear units 18b and 18c, and the total- 
reflection mirrors 17d and 17e respectively direct the light beams reflected from the 
cross prism 16b to the rear units 18d and 18e. Thus, the light from the image 
display device 15 is eventually formed into five light beams, with the light beam 
transmitted through both of the cross prisms 16a and 16b traveling at the center, 
and are then projected onto the five screens 11a to lie of the observation room 10. 

The shutters 19a to 19e shut off the light beams projected from the five 
projection optical systems in synchronism with the time-division display of the 
image display device 15. Specifically, the shutters 19a to 19e are each opened 
only while the image display device 15 is displaying the image to be projected onto 
corresponding one of the screens 11a to lie. This prevents an image to be 
projected onto one screen from being projected on another screen. In this 
embodiment, the shutters 19a to 19e are arranged in the optical paths of the light 
beams after passing through the rear units 18a to 18e of the projection optical 
systems; however, they may be arranged elsewhere as long as they are placed in the 
optical paths of the light beams after being split by the cross prisms 16a and 16b. 

As described above, the image display device 15 displays images on a time- 
division basis. Meanwhile, not only are the displayed images switched so as to 
correspond to the screens 11a to lie, but the displayed images are also inverted 
upside down and reversed the right side left in appropriate manners so that the 
images projected onto the screens lib to lie by way of the total-reflection mirrors 
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12b to 12e are continuous to the image projected directly onto the screen 11a. 
Specifically, the images to be projected onto the screens lib and 11c are displayed 
in a state reversed the right side left, and the images to be projected onto the 
screens lid and lie are displayed in a state inverted upside down. 
5 Fig. 3 schematically shows an example of the images projected onto the 

observation room 10, and Fig. 4 shows an example of the five images displayed on 
the image display device 15 to project the images shown in Fig. 3. The images 
shown in Fig. 4 are switched in the order indicated by arrows. These first (top 
left) to fifth (bottom right) images are the images projected onto the screens 11a to 

10 lie respectively. The second and third images that are projected onto the screens 
lib and 11c are reversed the right side left as compared with the first image that is 
projected onto the screen 11a, and the fourth and fifth images that are projected 
onto the screens lid and lie are inverted upside down as compared with the first 
image. The images may be displayed in any other order than is specifically 

15 described above. 

The optical path from the rear unit 18a of the projection optical system to 
the screen 11a, along which an image is projected without traveling by way of a 
total-reflection mirror, is shorter than the optical paths from the rear units 18b to 
18e of the other four projection optical systems to the screens lib to lie. 

20 Accordingly, if all the projection optical systems are designed to have identical 
constructions, images are formed differently on the screen 11a and on the other 
screens lib to lie, making either the image formed on the screen 11a or those 
formed on the other screens lib to lie less sharp. To prevent this, in the image 
display apparatus 1, the rear unit 18a is designed to have a different construction 
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so that the projection optical system including the rear unit 18a has a shorter focal 
length than the other projection optical systems. This makes it possible to display 
sharp images on all of the screens 11a to lie. 

The image display apparatus 1 can present a three-dimensional image. To 
5 achieve this, the image display device 15 is made to display images at double the 
time-division rate so that two images, one for the right eye and the other for the left 
eye, reflecting the parallax between the two eyes are projected onto each of the 
screens 11a and lie. On the other hand, the observer wears goggles provided with 
right and left shutters that are opened and closed alternately in synchronism with 
f*t 10 the switching of the images for the right and left eyes. By making the projected 
n\ image three-dimensional, it is possible to offer a very high degree of realism to the 

% observer. 

5— 

W As described above, the image display apparatus 1 projects images onto five 

!L screens that are arranged so as to surround the observer, and can thus present the 

^ 15 observer with an image covering a very wide field of view. Moreover, the image 
g display apparatus 1 requires only one image display device to display images to be 

projected, and thus has a simple construction. The rear face llf of the observation 
room 10 may also be used as a screen; in that case, a projector unit for projecting an 
image onto this screen is provided separately so that images are displayed on all of 
20 the six faces 11a to llf of the observation room 10. Alternatively, it is also 
possible to build a flat, thin image display device, such as a plasma or liquid crystal 
display device, into the rear face 11 so that images are displayed on all of the six 
faces 11a to llf of the observation room 10. 

Fig. 5 shows the outline of the overall construction of the image display 
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apparatus 2 of a second embodiment of the invention. In the image display 
apparatus 2, just like the image display apparatus 1 of the first embodiment, an 
image displayed in a projector unit 24 is projected onto an observation room 20 so 
that the image is presented to an observer inside the observation room 20. 
5 However, here, the projector unit 24 has a different construction from the projector 
unit 14 of the image display apparatus 1. Moreover, the observation room 20 has, 
in addition to five screens 21a, 21b, 21c, 21d, and 21e and four total-reflection 
mirrors 22b, 22c, 22d, and 22e, a lens 23. Except for this lens 23, the observation 
room 20 has the same construction as the observation room 10 of the image display 
10 apparatus 1. 

Fig. 6 shows the construction of the projector unit 24. The projector unit 24 
is composed of one image display device 25 and one projection optical system 28. 
In the image display apparatus 2, unlike the image display apparatus 1, the entire 
image covering a wide space that is to be presented to the observer is displayed on 

15 the image display device 25 all at once, and the projection optical system 28 
projects the image simultaneously. 

The image display device 25 displays the image to be projected onto the 
screen 21a of the observation room 20 in a central portion of the display surface 
thereof, and displays the images to be projected onto the screens 21b to 21e in left- 

20 hand, right-hand, lower, and upper portions of the display surface thereof. Also 
here, to make the images projected onto the screens 21b to 21e by way of the total- 
reflection mirrors 22b and 22e continuous to the image projected directly onto the 
screen 21a, the images displayed in the left-hand and right-hand portions are 
displayed in a state reversed the right side left, and the images displayed in the 
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upper and lower portions are displayed in a state inverted upside down. Fig. 7 
shows an example of the images displayed on the image display device 25. This 
example shows the image displayed to project the images shown in Fig. 3 onto the 
observation room 20. 

5 The projection optical system 28 is given a focal length that permits the light 

projected by way of the total-reflection mirrors 22b to 22e to be focused on the 
screens 21b and 21e. Thus, the projection optical system 28 cannot focus the light 
that is projected directly onto the screen 21a. It is to compensate for this 
difference in optical path length and thereby make the image projected onto the 

10 screen 21a sharp that the lens 23 is disposed immediately in front of the screen 21a. 
The lens 23 is formed as a Fresnel lens so that it is so large as to correspond to one 
face of the observation room 20 that houses the observer and is simultaneously as 
thin and light as possible. 

It is also possible to give the projection optical system 28 a focal length that 

15 is adjusted to the screen 21a and provide lenses for compensating the optical path 
lengths between the total-reflection mirrors 22b to 22e and the screens 21b to 21e 
or between the total-reflection mirrors 22b to 22e and the projection optical system 
28. Also in that case, it is preferable to form those lenses as Fresnel lenses. 

Moreover, as described previously in connection with the first embodiment, 

20 it is possible to make the projected image three-dimensional by displaying two 
images, one for the right eye and the other for the left eye, reflecting the parallax 
between the two eyes on a time-division basis. This helps obtain a very high 
degree of realism. 

The image display apparatus 2 of this embodiment requires only one image 
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display device and in addition only one projection optical system, and thus has a 
simpler construction than the image display apparatus 1 of the first embodiment. 
Also here, it is possible to display images on all of the six faces 21a to 2lf of the 
observation room 20 in the manners described previously in connection with the 
5 first embodiment. 

Figs. 8A, 8B, and 8C show the outline of the overall construction of the 
image display apparatus 3 of a third embodiment of the invention. Fig. 8 A is a 
perspective view of the image display apparatus 3, Fig. 8B is a top view thereof as 
seen from the direction indicated by arrow B shown in Fig. 8A, and Fig. 8C is a side 
« 10 view thereof as seen from the direction indicated by arrow C shown in Fig. 8A. 

Ah 

m The image display apparatus 3 has an observation room 30, which has the shape of 

Li I 

a hollow rectangular parallelepiped with its ceiling face and one of its side faces 
removed. As with the observation room 10 of the image display apparatus 1, also 
here, the front face 31a, the left and right side faces 31b and 31c, and the floor face 
15 3 Id of the observation room 30 are formed as transmissive, dispersive screens. 

To project images onto the four screens 31a to 3 Id, the image display 
apparatus 3 is provided with two projector units 34a and 34b. Although not 
illustrated, the projector units 34a and 34b each have one image display device and 
one projection optical system. The image display device of the projector unit 34a 
20 displays the two images to be projected onto the screens 31a and 31b, and the 
image display device of the projector unit 34b displays the two images to be 
projected onto the screens 31c and 3 Id. 

At the outward-facing (back) sides of the screens 31a and 31b of the 
observation room 30, total-reflection mirrors 32a and 32b are disposed that direct 
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the light from the projector unit 34a to the screens 31a and 31b. Similarly, at the 
outward-facing (back) sides of the screens 31c and 31d of the observation room 30, 
total-reflection mirrors 32c and 32d are disposed that direct the light from the 
projector unit 34b to the screens 31c and 31d. These total-reflection mirrors 32a 
to 3 2d are so shaped as to have increasingly narrow widths toward the projector 
units 34a and 34b. 

Between the projector unit 34a and the total-reflection mirror 32a, a half 
mirror 36a is disposed that transmits one half of the light from the projector unit 
34a to direct it to the total-reflection mirror 32a and that reflects the other half to 
direct it to the total-reflection mirror 32b. Similarly, between the projector unit 
34b and the total-reflection mirror 32d, a half mirror 36b is disposed that transmits 
one half of the light from the projector unit 34b to direct it to the total-reflection 
mirror 3 2d and that reflects the other half to direct it to the total-reflection mirror 
32c. 

Furthermore, in the optical paths of the light transmitted through and 
reflected from the half mirror 36a, shutters 39a and 39b (not shown in Fig. 8A) are 
disposed respectively. Similarly, in the optical paths of the light transmitted 
through and reflected from the half mirror 36b, shutters 39d and 39c are disposed 
respectively. 

The image display devices of the projector units 34a and 34b, like the image 
display device 15 of the image display apparatus 1, display images on a time- 
division basis. The shutters 39a and 39b are opened and closed in synchronism 
with the time-division display of the projector unit 34a, and the shutters 39c and 
39d are opened and closed in synchronism with the time-division display of the 
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projector unit 34b. As a result, the images that are to be projected onto the screens 
31a to 31d are projected properly onto the respective screens. 

The image display apparatus 3 of this embodiment permits images to be 
projected onto four screens arranged so as to surround the observer by the use of 
5 two image display devices and two projection optical systems. Thus, this image 
display apparatus 3 has a simple construction but nevertheless offers an image 
covering a wide field of view. It is also possible to additionally provide another 
set of elements like the screens 31a and 31b, the projector unit 34a, the mirrors 32a, 
32b, and 36a, and the shutters 39a and 39b so that images are displayed on all of 
ri 10 the six faces of the observation room. 

fn Fig. 9 shows the outline of the overall construction of the image display 

% z apparatus 4 of a fourth embodiment of the invention. Fig. 9 is a top view of the 

if: image display apparatus 4. The image display apparatus 4 has an observation 

L, room 40, which has the shape of a hollow rectangular parallelepiped with its floor 

S 15 and ceiling faces and one of its side faces removed. As with the observation room 
rj 10 of the image display apparatus 1, also here, the front face 41a and the left and 

right side faces 41b and 41c of the observation room 40 are formed as transmissive, 

dispersive screens. 

To project images onto the three screens 41a to 41c, the image display 
20 apparatus 4 is provided with two projector units 44a and 44b. Although not 
illustrated, the projector units 44a and 44b each have one image display device and 
one projection optical system. The image display device of the projector unit 44a 
displays the two images to be projected onto the screens 41a and 41b, and the 
image display device of the projector unit 44b displays the two images to be 
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projected onto the screens 41a and 41c. That is, in the image display apparatus 4, 
the images from the two projector units 44a and 44b are projected onto the front 
screen 41a. 

At the outward-facing (back) sides of the screens 41b and 41c of the 
5 observation room 40, total-reflection mirrors 42b and 42c are disposed that direct 
the light from the projector units 44a and 44b to the screens 41b and 41c. On the 
other hand, at the outward-facing (back) side of the screen 41a of the observation 
room 40, a cross half mirror 42a is disposed that directs the light from the projector 
units 44a and 44b to the screen 41a. 
□ 10 Moreover, between the projector unit 44a and the cross half mirror 42a, a 

half mirror 46a is disposed that transmits one half of the light from the projector 
unit 44a to direct it to the cross half mirror 42a and that reflects the other half to 
direct it to the total-reflection mirror 42b. Similarly, between the projector unit 
44b and the cross half 42a, a half mirror 46b is disposed that transmits one half of 
15 the light from the projector unit 44b to direct it to the cross half mirror 42a and that 
reflects the other half to direct it to the total-reflection mirror 42c. 

Furthermore, in the optical paths of the light transmitted through and 
reflected from the half mirror 46a, shutters 49a and 49b are disposed respectively, 
and, in the optical paths of the light transmitted through and reflected from the half 
20 mirror 46b, shutters 49a' and 49c are disposed respectively. 

The image display devices of the projector units 44a and 44b, like the image 
display device 15 of the image display apparatus 1, display images on a time- 
division basis. In addition, the projector units 44a and 44b operate in 
synchronism with each other so that the image from the projector unit 44a and the 
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image from the projector unit 44b are projected alternately onto the screen 41a. 
The shutters 49a and 49b are opened and closed in synchronism with the time- 
division display of the projector unit 44a, and the shutters 49a' and 49c are opened 
and closed in synchronism with the time-division display of the projector unit 44b. 
5 As a result, the images that are to be projected onto the screens 41a to 41c are 
projected properly onto the respective screens. 

With this construction, by introducing an appropriate parallax between the 
image projected from one projector unit 44a onto the screen 41a and the image 
projected from the other projector unit 44b onto the screen 41a, and by making the 

O 10 observer wear goggles provided with right and left shutters that are opened and 

il 

closed alternately in synchronism with the time-division display of the projector 
f t units 44a and 44b, it is possible to present a three-dimensional image readily. In 

p that case, only the image displayed on one screen 41a is made three-dimensional, 

f j and this helps greatly simplify the control required as compared with cases where 

0 15 the images displayed on all the screens are made three-dimensional. Simply by 
|f making only the image presented in front of the observer three-dimensional, it is 

possible to greatly enhance the realism offered to the observer. 

By providing another complete set of elements as described above, it is 
possible to display images on all of the six faces of the observation room. 
20 Figs. 10A, 10B, and 10C show the outline of the overall construction of the 

image display apparatus 5 of a fifth embodiment of the invention. Fig. 10A is a 
perspective view of the image display apparatus 5, Fig. 10B is a top view thereof as 
seen from the direction indicated by arrow B shown in Fig. 10A, and Fig. 10C is a 
side view thereof as seen from the direction indicated by arrow C shown in Fig. 
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10A. The image display apparatus 5 has an observation room 50, which has the 
shape of a hollow rectangular parallelepiped. The front face 51a, one side face 
51b, and the floor face 5 Id of the observation room 50 are formed as transmissive, 
dispersive screens. 

To project images onto the three screens 51a, 51b, and 5 Id, the image 
display apparatus 5 is provided with one projector unit 54. Although not 
illustrated, the projector unit 54 has one image display device and one projection 
optical system. Of the images that the image display device of the projector unit 
54 displays, the two that are to be projected onto the screens 51a and 51b represent 
a space extending continuously from the front to the side, and thus they contain no 
clear boundary that divides, for example, a part thereof representing a space located 
at the front and a part thereof representing a space located at the side. The 
observer normally observes the projected image in a position just facing the 
boundary between the screens 51a and 51b. 

To split the light from the projector unit 54 into three light beams and direct 
them to the screens 51a, 51b, and 5 Id, the image display apparatus 5 is provided 
with two half mirrors 56a and 56b and six total-reflection mirrors 52a, 52a', 52b, 
52b', 52d, and 52d\ Part of the light from the projector unit 54 is reflected from 
the half mirror 56a, is then reflected from the total-reflection mirror 52a' and then 
from the total-reflection mirror 52a, and is directed to the screen 51a. Part of the 
light transmitted through the half mirror 56a is reflected from the half mirror 56b, 
is reflected from the total-reflection mirror 5 2d' and then from the total-reflection 
mirror 5 2d, and is directed to the screen 5 Id. The light transmitted through the 
half mirror 56b is reflected from the total-reflection mirror 52b' and 52b, and is 
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directed to the screen 51b. 

In the optical path of the light reflected from the half mirror 56a is disposed 
a shutter 59a (not shown in Figs. 10A and IOC). Moreover, in the optical paths of 
the light transmitted through and reflected from the half mirror 56b are disposed 
5 shutters 59b and 59d respectively (not shown in Figs. 10 A and IOC). 

The image display device of the projector unit 54, like the image display 
device 15 of the image display apparatus 1, display images on a time-division basis. 
The shutters 59a, 59b, and 59d are opened and closed in synchronism with the 
time-division display of the projector unit 54, and thereby the images that are to be 
O 10 projected onto the screens 51a, 51b, and 5 Id are projected properly onto the 
B 1 - respective screens. 

m 

~!f Also in the image display apparatus 5, it is possible to make the projected 

%t image three-dimensional by making the image display device display images at 

s 

□ double the time-division rate so that two images, one for the right eye and the other 

E3 15 for the left eye, reflecting the parallax between the two eyes are displayed on each 
B screen. This helps further enhance the realism offered to the observer. Moreover, 

by forming also the other three faces of the observation room 50 as screens and 
providing another set of a projector unit and other elements as described above, it 
is possible to display images onto all of the six faces of the observation room 50. 
20 Fig. 11 shows the outline of the overall construction of the image display 

apparatus 6 of a sixth embodiment of the invention. In the image display 
apparatus 6, an observation room 60 is mounted on a motor vehicle so as to be 
mobile. The image display apparatus 6 is of a direct-display type in which the 
wall faces of the observation room 60 themselves display images. The observation 
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room 60 has the shape of a hollow rectangular parallelepiped, and is so large as to 
house an observer in a standing position. The four side faces, floor face, and 
ceiling face of the observation room 60 each have a plurality of flat, thin image 
display devices, such as plasma or liquid crystal display devices, built therein. Of 
5 the four side faces, the one located at the rear end of the motor vehicle, or one of 
the image display devices built therein, is made openable so as to serve as a door 
that permits the observer in and out. 

Fig. 12 is a perspective view of one side face of the observation room 60. 
The observation room 60 has a frame member 63, to which a plurality of image 

10 display devices 65 are fixed. A perspective view of the frame member 63 and a 
horizontal sectional view thereof with image display devices fitted thereto are 
shown in Figs. 13 and 14 respectively. On all faces, the image display devices 65 
are fitted to the frame member 63 from outside. The floor face is covered all over 
with a scratch-resistant, transparent plate, which serves to protect the image 

15 display devices 65 built in the floor face. 

The image display devices 65 may be fitted to the frame member 63 from 
inside. A perspective view of one side face of the observation room 60 and a 
sectional view of the frame member 65 when the image display devices 65 are fitted 
from inside are shown in Figs. 15 and 16 respectively. Since the frame member 63 

20 has its own thickness, when the image display devices 65 are fitted to the frame 
member 63 from outside, there is a possibility that the images displayed on the 
image display devices 65 suffer vignetting in their peripheral portions depending 
on the angle of the line of sight of the observer. By contrast, when the image 
display devices 65 are fitted to the frame member 63 from inside, there is no 
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possibility at all of such vignetting caused by the frame member 63. Moreover, 
even if the frame member 63 is made wider to ease the fitting of the image display 
devices 65, this has no effect on the displayed images. 

The image display apparatus 6 of this embodiment is mobile, and can 
5 therefore present images with a high degree of realism at various locations. 
Although here the observation room is built as a direct-display type, it may be built 
as a projection type. In that case, as described previously in connection with the 
first to fifth embodiments, it is possible to simplify the construction by making the 
number of image display devices smaller than the number of screens. 
B 10 Fig. 17 shows the outline of the construction of the image display apparatus 

7 of a seventh embodiment of the invention. This image display apparatus 7 has 
If an observation room 70, which has the shape of a hollow rectangular 

parallelepiped. Fig. 17 is a perspective view showing the inside of the observation 
room 70. The six faces of the observation room 70 have flat, thin image display 
15 devices, such as plasma or liquid crystal display devices, built therein. At the 
center of the floor face 71d is provided a turntable 78 fitted with a treadmill 73. 
As shown in Fig. 18, on the floor face 71d, the image display devices 75 are 
arranged around the turntable 78. 

Fig. 19 shows the treadmill 73. The treadmill 73 is composed of two rollers 
20 73b and 73c arranged parallel to each other, a belt 73a suspended on and over the 
interval between the rollers 73b and 73c, a motor 73d for rotating the roller 73b, 
and a belt 73e that transmits the rotating of the motor 73d to the roller 73b. 

Figs. 20A, 20B, and 20C show the turntable 78. Figs. 20A and 20B are 
perspective views of the turntable 78 as seen obliquely from above and obliquely 
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from below respectively. The turntable 78 has a cylindrical projection 78a 
provided at its bottom, and this projection 78a engages with a driving member 78b 
that rotates the turntable 78. Fig. 20C is a perspective view of the driving member 
78b as seen obliquely from above. The driving member 78b is fed with a rotating 
5 force from a motor (not shown). 

The observer rides on the belt 73a of the treadmill 73 while observing the 
images displayed on the faces of the observation room 70. The treadmill 73 and 
the turntable 78 are designed to operate in accordance with remote control by the 
observer, and the rotation speed of the belt 73a and the orientation angle of the 
10 turntable 78 can be set at will by the observer. Moreover, the images displayed on 
the image display devices 75 on the observation room faces are varied in 
accordance with the rotation speed of the belt 73a and the orientation of the 
turntable 78. 

In this image display apparatus 7 constructed as described above, the 
15 observer, while acting like walking at speed corresponding to the rotation speed of 
the belt 73a, has a sensation that he is actually walking, without traveling any 
distance at all in reality, on the basis of his own movement and the varying images. 
Moreover, by varying the orientation of the turntable while acting like walking, the 
observer can also have a sensation that he is turning his course. It is possible to 
20 additionally provide a walking movement detector that detects the walking pace 
and the foot direction of the observer so that the rotation speed of the belt 73a and 
the orientation of the turntable 78 are varied in accordance with the detection 
results obtained from that detector. This makes it possible to offer a more natural 
sensation of walking to the observer. 
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The image display apparatus 7 of this embodiment also is built as a direct- 
display type; however, it is also possible to combine a turntable fitted with a 
treadmill with a projection-type image display apparatus that uses fewer image 
display devices than screens as described previously in connection with the first to 
5 fifth embodiments. Moreover, it is also possible, as in the sixth embodiment, to 
mount the image display apparatus on a motor vehicle so as to make it mobile. 

Fig. 21 shows the outline of the construction of the image display apparatus 
8 of an eighth embodiment of the invention. The image display apparatus 8 has 
an observation room 80, which has the shape of a hollow rectangular 

10 parallelepiped. Fig. 21 is a perspective view showing the external appearance of 
the observation room 80. The six faces of the observation room 80 have flat, thin 
image display devices, such as plasma or liquid crystal display devices, built 
therein. In this image display apparatus 8, the observation room 80 is filled with 
water W, and the observer observes images from underwater. The observation 

15 room 80 is designed to withstand water pressure, and its floor face and four side 
faces are made water-tight. 

The ceiling face 81e of the observation room 80 is movable in a horizontal 
direction so that, after the observer has entered the observation room 80, the ceiling 
face 81e is moved so as to close the entire observation room 80. Fig. 22 shows the 

20 observation room 80 in its closed state. To permit the observer inside the 
observation room 80 to be monitored even when the observation room 80 is closed, 
monitoring cameras 83 are provided inside the observation room 80. This permits, 
in case of an accident to the observer, the ceiling face 81e to be moved quickly so 
that the observer may be rescued out of the observation room 80. This makes the 
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image display apparatus 8 highly safe. 

In the image display apparatus 8, by displaying an image representing an 
underwater scene, it is possible to offer the observer a sensation that he is in the see. 
Meanwhile, the observer feels resistance of water and buoyancy, which adds to the 
5 realism offered to the observer. 

The water level inside the observation room 80 may be set freely; that is, it 
may be such that the water surface reaches the ceiling face 81e, or such that a space 
is left between the water surface and the ceiling face 81e. In the former case, the 
observer uses a breathing assist apparatus while observing images. When the 
p 10 water level is set so low as to leave a space between the water surface and the 
§1 ceiling face 81e, the image displayed on the ceiling face 81e is disturbed by 

y i 

% i irregular reflection on the water surface, which acts to enhance the sensation that 

4= 

j^f the observer is looking into the air from underwater. 

L When the observer wears an appropriate weight, the buoyancy of water is 

p 15 canceled by gravity. This offers the observer a floating sensation. Meanwhile, by 
displaying an image representing outer space in the observation room 80, it is 
possible to offer the observer a sensation that he is in gravity-free space. In that 
case, to prevent irregular reflection on the water surface, it is preferable that the 
water level be so set that the water surface reaches the ceiling face 81e. 
20 Here, the observation room 80 is opened and closed by moving the ceiling 

face 81e in a horizontal direction; however, it may be opened and closed in any 
other manner. For example, part of the ceiling face 81e is formed into a door that 
rotates about a level axis. Alternatively, part of the ceiling face 81e is left open all 
the time. In these constructions, the ceiling face 81e may be designed to be 

-26- 



movable up and down. This makes it possible to vary the distance from the water 
surface to the ceiling face 81e not by varying the water level but by varying the 
level of the ceiling face 81e. 

The image display apparatus 8 of this embodiment also is built as a direct- 
display type; however, it is also possible to fill the observation room of a projection- 
type image display apparatus with water so that images can be observed from 
underwater. In that case, for example, wall faces are made of a highly strong 
transparent material so as to withstand water pressure, and screens are arranged on 
the outward-facing (back) sides of those wall faces. Moreover, it is possible to 
simplify the construction by making the number of image display devices smaller 
than the number of screens as described previously in connection with the first to 
fifth embodiments. Moreover, it is also possible to mount the image display 
apparatus on a motor vehicle so as to make it mobile. 

Fig. 23 shows the outline of the overall construction of the image display 
apparatus 9 of a ninth embodiment of the invention. The image display apparatus 
9 includes two observation rooms 90a and 90b and one controller 93. In Fig. 23, 
the observation rooms 90a and 90b are illustrated as being see-through. The 
observation rooms 90a and 90b each have the shape of a hollow rectangular 
parallelepiped, and each have six faces on which images are displayed. The 
observation rooms 90a and 90b each house one observer who observes the images 
displayed therein. 

The controller 93 controls the images displayed in the observation rooms 90a 
and 90b. Specifically, the controller 93 generates images common to the two 
observation rooms 90a and 90b in accordance with the position of the observers 
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inside the individual observation rooms 90a and 90b, then adds to the image for 
each observation room an image representing the observer inside the other 
observation room, and then displays the resulting images in the observation rooms 
90a and 90b. That is, the images displayed in the observation rooms 90a and 90b 
5 are almost the same, except that they include some difference resulting from the 
difference in position of the observers inside the observation rooms 90a and 90b, 
and that the image displayed in the observation room 90a includes the image of the 
observer inside the observation room 90b and the image displayed in the 
observation room 90b includes the image of the observer inside the observation 
10 room 90a. 

5] In the image displayed in each of the observation rooms 90a and 90b, the 

image included therein of the observer inside the other observation room is not 
fixed, but is varied according to the movement of that observer, i.e. according to the 
positions of various parts of his body. To permit detection of the positions of 
15 various parts of their bodies, the observers each wear signal generators 96, such as 
supersonic wave oscillators or infrared light emitters, at their head, shoulders, 
waist, arms, hand, legs, feet, and others, and in addition, in the corners of the 
observation rooms 90a and 90b, signal detectors 97, such as supersonic wave 
sensors or infrared light sensors, corresponding to the signal generators 96 are 
20 arranged. The different signal generators 96 worn by one observer generate signals 
having different characteristics in terms of their frequency, wavelength, number of 
pulses, and others so that the individual signal detectors 97 can identify the signals 
output from the corresponding signal generators 96. The signal detectors 97, on 
the basis of the signals they detect, identify the positions of the individual signal 
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generators 96, and feed their positions to the controller 93. 

The controller 93 is thus fed with the positions of the individual signal 
generators 96 from eight signal detectors 97, and, for each of the signal generators 
96, calculates the average of eight positions to determine the position of that signal 
5 generator, i.e. the position of the part of the observer's body corresponding to that 
signal generator. Depending on the posture and orientation of the observer, it is 
not always possible for all of the signal detectors 97 to detect the signals from all of 
the signal generators 96. However, the signal from any of the signal generators 96 
can be detected by at least one of the signal detectors 97 at any time, and therefore 
S3 10 it is possible to detect the positions of various parts of the observers' bodies all the 

'si J 

B 1 time. 

H On the basis of the thus detected positions of various parts of the observers' 

bodies, the controller 93 generates three-dimensional images of the observers. The 
controller 93 achieves this by first producing the skeletons that reflect the detected 
15 positions of various parts of the observers' bodies, and then subjecting the obtained 
skeletons to a rendering process, which produces therefrom images with sufficient 
fleshiness to represent the observers in their clothes. Before the observers enter 
the observation rooms 90a and 90b, their images are shot from a plurality of 
directions so that, in the rendering process, those images are referred to in order to 
20 make their images look as much like the observers themselves as possible. 

Fig. 24 shows the outline of the configuration of the controller 93. The 
controller 93 includes an observer position data processor 101 that determines the 
positions of various parts of the observers' bodies by processing the position data 
fed from the signal detectors 97, a human image generator 102 that generates 
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images representing the observers on the basis of the thus determined positions, an 
image database 103 in which texture data necessary to produce images is stored, 
and a display image generator 104 that generates images to be displayed in the 
individual observation rooms. 
5 The observer position data processor 101 is composed of a position data 

processor 101a for determining the position of the observer inside one observation 
room 90a and a position data processor 101b for determining the position of the 
observer inside the other observation room 90b. The human image generator 102 
is composed of an observer image generator 102a for generating the image of the 
O 10 observer inside the observation room 90a and an observer image generator 102b for 
generating the image of the observer inside the observation room 90b. The display 



image generator 104 is composed of an observation room image generator 104a for 
generating an image to be displayed in the observation room 90a and an 
observation room image generator 104b for generating an image to be displayed in 

15 the observation room 90b. 

The image database 103 includes observer image data 103a representing the 
image of the observer inside the observation room 90a, observer image data 103b 
representing the image of the observer inside the observation room 90b, and also 
common image data 103c representing the image common to the two observation 

20 rooms 90a and 90b. 

The position data processors 101a and 101b respectively receive positional 
data from the signal detector groups 97a and 97b arranged in the observation rooms 
90a and 90b, and calculate average positions as described above and thereby 
determine the positions of various parts of the bodies of the individual observers. 
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Moreover, on the basis of the thus determined positions of various parts of the 
observers' bodies, they also determine the positions of the entire bodies of the 
observers inside the observation rooms 90a and 90b. On the basis of the positions 
of various parts of the observers' bodies fed from the position data processors 101a 
5 and 101b, the observer image generators 102a and 102b process the observer image 
data 103a and 103b and generate images of the individual observers. 

On the basis of the observers' positions fed from the position data processors 
101a and 101b, the observation room image generators 104a and 104b individually 
process the common image data 103 and generate common images that reflect the 
O 10 individual observers' positions. The two common images generated here have the 
same content but include some difference resulting from the difference in position 

i_ 3 

3* of the two observers inside the observation rooms 90a and 90b. 

Sf The observation room image generator 104a integrates together one of the 



ri 



generated common images and the image representing the observer inside the 
15 observation room 90b fed from the observer image generator 102b. Similarly, the 
observation room image generator 104b integrates together the other of the 
generated common images and the image representing the observer inside the 
observation room 90a fed from the observer image generator 102a. As a result, the 
image displayed in each of the observation rooms 90a and 90b includes the image 
20 of the observer inside the other observation room. 

The observation room image generators 104a and 104b respectively feed 
video signals representing the thus generated images to display circuits 98a and 
98b of the observation rooms 90a and 90b, so that the display circuits 98a and 98b 
display those images individually in the observation rooms 90a and 90b. 
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Fig. 25 schematically shows the images and the observers inside the 
observation rooms 90a and 90b. In Fig. 25, the observers indicated by solid lines 
are the observers that are actually present inside the observation rooms 90a and 
90b, and the observers indicated by broken lines are the observers that each actual 
5 observer recognizes as the other observer by the displayed images. In Fig. 25, the 
observers are illustrated as skeletons; however, in reality, the images generated by 
the controller 93 represent them with fleshiness as described earlier. 

As described above, the image display apparatus 9 presents both of the 
observers with images with a high degree of realism, and in addition offers them a 
E- 1 10 sensation that each observer is beside the other observer and the two are having a 
f t * common experience. In the observation rooms 90a and 90b shown in Fig. 25, a 

jS treadmill 73 as described previously in connection with the seventh embodiment is 

p provided, so that the two observers can enjoy a sensation that they are walking side 

£3 by side. 

S 15 Here, to permit detection of the positions of various parts of the observers' 

bodies, the observers wear the signal generators 96 and the observation rooms 90a 
and 90b are fitted with the signal detectors 97. However, it is also possible to fit 
the signal generators 96 to the observation rooms 90a and 90b and fit the signal 
detectors 97 to the observers. In that case, the observers need to wear also 
20 transmitters for transmitting the detected positions to the controller 93. Detection 
of the positions of various parts of the observers' bodies may be achieved in any 
manner. For example, such detection can be achieved by monitoring the 
observers through cameras. It is then also possible to capture the expressions of 
the observers and reflect those expressions in the observers 5 images to be displayed. 
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This helps further enhance realism. 

In the image display apparatus 9, the image displayed in one observation 
room includes the image of the observer inside the other observation room. This 
can be practiced irrespective of the construction adopted to display the images. 
5 Specifically, the image display apparatus 9 may be built as a direct-display type in 
which image display devices are built in the faces of the observation rooms 90a and 
90b, or as a projection type in which those faces are formed as screens onto which 
images are projected from image display devices. When the image display 
apparatus 9 is built as a projection type, as described earlier in connection with the 

10 first to fifth embodiments, it is possible to simplify the construction by making the 
number of image display devices smaller than the number of screens. In the 
image display apparatus 9, the images projected onto its two observation rooms 90a 
and 90b may be displayed with a single set of image display devices. 

The above description deals with a case where the image display apparatus 

15 is provided with two observation rooms 90a and 90b; however, it is also possible to 
provide it with three or more observation rooms. In that case, through control 
similar to that described above, it is possible for a number of observers to share an 
image with a high degree of realism. 

Obviously, many modifications and variations of the present invention are 

20 possible in light of the above teachings. It is therefore to be understood that within 
the scope of the appended claims, the invention may be practiced other than as 
specifically described. 
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